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Abstract - In this paper we present a unified approach 
for optimal control and filtering of linear continuous-time sin¬ 
gularly perturbed linear systems that facilitates complete and 
exact decomposition of optimal control and filtering tasks into 
pure-slow and pure-fast time scales. The presented methodol¬ 
ogy eliminates numerical ill-conditioning of the original singu¬ 
larly perturbed problems, introduces parallelism into the design 
procedures, allows independent parallel processing of informa¬ 
tion in slow and fast time scales, and reduces both off-line and 
on-line computation requirements. The presentation is done 
for the classic linear-quadratic open- and closed-loop optimal 
regulators, Kalman filter, 11 > -optima! linear-quadratic regu¬ 
lator, Hoo-optimal linear filter, and the corresponding linear- 
quadratic optimal stochastic regulators. In addition, we indicate 
related control problems solvable by the presented methodology. 

Key words: Singular perturbations, optimal control, 
Kalman filtering, II x _ optimization. 

I. INTRODUCTION 

Theory of singular perturbations was introduced to control 
audience by Kokotovic by the end of the sixties. Due 
to the fact that many real physical systems are singu¬ 
larly perturbed, for example, aircrafts, robots, electrical cir¬ 
cuits, power systems, nuclear reactors, chemical reactors, 
dc and induction motors, synchronous machines, distilla¬ 
tion columns, flexible structures, automobiles, this theory 
has become very popular in control system engineering, 
[l]-[7]. Singularly perturbed systems are characterized by 
simultaneous presence of small and large time constants, 
which introduces clustering of linear (or linearized) sys¬ 
tem eigenvalues into two disjoint groups: (a) eigenvalues 
corresponding to large time constants located close to the 
imaginary axis representing slow system state space vari¬ 
ables (slow modes), and (b) eigenvalues corresponding to 
small time constants located far from the imaginary axis 
representing fast system state space variables (fast modes). 
In the last thirty years almost one thousand journal papers 
and more than twenty books were published by engineering 
and mathematics researchers on the subject of singularly 
perturbed control systems. 

The notion of singular perturbations in mathematics 
stands for systems of differential equations that have some 
derivatives multiplied by small positive parameters. Such 


a kind of systems of differential equations was extensively 
studied in the fifties and sixties by well-known mathemati¬ 
cians such as Tikhonov, Levin, Levinson, Vasileva, Butu¬ 
zov, Wasov, Hoppendsteadt, O’Malley, Chang. One of the 
most important and most widely used results of mathemat¬ 
ical theory of singular perturbations is the development of 
the transformation for the exact pure-slow and pure-fast de¬ 
composition of linear singularly perturbed systems, known 
as the Chang transformation, [8]. 

The approaches taken in engineering during the sev¬ 
enties and eighties, in the study of singularly perturbed 
control systems, were based on expansion methods (power 
series, asymptotic expansions, Taylor series), the meth¬ 
ods developed by previously mentioned mathematicians. 
The approaches were, in most cases, accurate only with 
an O(e) 1 accuracy, where e is a small positive singular 
perturbation parameter. Generating higher order expan¬ 
sions for those methods has been analytically pretty cum¬ 
bersome and numerically pretty inefficient, especially for 
high-dimensional control systems. Even more, it has been 
demonstrated in several papers, [9]-[ 12], that for some ap¬ 
plications an O(e) accuracy is either not sufficient or even 
more, it does not solve the problem at all. 

The development of high accuracy efficient techniques 
for singularly perturbed control systems started in the mid¬ 
dle of the eighties along the lines of the slow-fast mani¬ 
fold approach of Sobolev, [13], and the recursive approach 
based on fixed-point iterations of Gajic, [14], At the begin¬ 
ning of the nineties, the fixed-point recursive approach cul¬ 
minates in the so-called Hamiltonian approach for the exact 
pure-slow and pure-fast decomposition of singularly per¬ 
turbed, linear-quadratic, deterministic and stochastic, op¬ 
timal control and filtering problems. The class of prob¬ 
lems solvable by the Hamiltonian approach are steady 
state linear-quadratic optimal control and filtering problems 
whose Hamiltonian matrices under appropriate scaling and 
permutation preserve singularly perturbed forms such that 
they can be exactly block diagonalized into pure-slow and 
pure-fast Hamiltonian matrices. That is why, we call this 
approach the Hamiltonian approach to singularly perturbed 

1 An O (e') stands for O (/') < ce r , where c is a bounded constant 

and r is any real number. 



optimal linear control systems. Note that the study of sin¬ 
gularly perturbed linear-quadratic optimal control systems 
via the use of the Hamiltonian system of differential equa¬ 
tions have been done in the past in different set ups by 
several researchers, for example, [15]-[20], 

The problems presently solvable by the Hamilton¬ 
ian approach are: linear-quadratic optimal regulator and 
Kalman filter in continuous- and discrete-time domains, 
optimal open-loop control of continuous- and discrete¬ 
time linear systems, multimodeling estimation and control, 
/4c -optimal control and filtering of linear systems, linear- 
quadratic zero-sum differential games, linear-quadratic 
high gain, cheap control, and small measurement noise 
problems, sampled data control systems, and nonstandard 
linear singularly perturbed optimal control and filtering sys¬ 
tems. Some other classes of linear-quadratic type optimal 
control problems that can be solved by the methodology 
considered in this paper may emerge in the near future. 

The work of [13] based on slow-fast manifold theory 
resulted also in the exact pure-slow and pure-fast decom¬ 
position of the linear-quadratic optimal control problems as 
demonsUated in [21]-[22]. However, it remains an open 
question whether or not the integral manifold approach to 
decomposition of singularly linear-quadratic control prob¬ 
lems [21]-[22] leads to the same results as those obtained 
by the Hamiltonian approach. 

This paper represents a comprehensive view of the 
current state of the knowledge of the Hamiltonian approach 
to singularly perturbed linear continuous-time optimal con¬ 
trol and filtering problems. The presentation is based on 
the recent research work of the authors and their cowork¬ 
ers. The paper presents a unified theme about the exact 
pure-slow pure-fast decoupling of the corresponding opti¬ 
mal control and filtering problems owing to the existence 
of a transformation that exactly decouples the nonlinear al¬ 
gebraic Riccati equation into the pure-slow and pure-fast, 
reduced-order, algebraic Riccati equations. At the same 
time, the paper demonsUates the power of the Hamiltonian 
approach clearly indicating the unified theme that can be 
used for the most efficient and most accurate solution of 
variety of optimal control and filtering problems. 


efficient parallel algorithm for solving this equation—the 
most important equation of the linear-quadratic optimal 
control and filtering theory. 

The procedure used for the time-scale decomposition 
of the algebraic Riccati equations into the pure-slow and 
pure-fast algebraic Riccati equations facilitates new in¬ 
sights into optimal filtering and control problems of sin¬ 
gularly perturbed linear systems. It is demonsUated in 
the subsequent sections that corresponding reduced-order 
linear optimal filters and controllers are completely and 
exactly decoupled. The slow/fast filters and controllers 
work in parallel and process information independently in 
slow and fast time scales with the corresponding sampling 
rates—the slow ones with the slow sampling rate and the 
fast ones with the fast sampling rate. 

A linear singularly perturbed control system is given 
by 


*i(f) = Aixi(t) + A 2 x 2 (t) + xi(t 0 ) — *10 

ex 2 (t) — A 3 xi(t) + .1 4 *l-(/) + B 2 u(t ), x 2 (t 0 ) — *20 

( 1 ) 

where *j(f) E 9?”', i — 1,2, u(t) E $t m are state and 
control variables, respectively, and e is a small positive 
singular perturbation parameter. As a parameter e tends to 
zero, the solution behaves nonuniformly, producing a so- 
called singularly perturbed stiff problem (huge slope for 
the fast state variable at the initial time), which implies 
numerical ill-conditioning. 

With (1), consider the performance criterion to be 
minimized by the choice of the optimal control sttategy 
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with positive definite R and positive semidefinite Q. The 
open-loop optimal control problem of (l)-(2) has the so¬ 
lution 


u(t) = -R~ 1 B T p(t) (3) 


where p(t) E 3f ni +" 2 is a costate variable satisfying [23] 


A. Exact Decomposition of the Riccati Equation 

In this section, it is shown how to exactly decompose the 
algebraic Riccati equation of singularly perturbed control 
systems into two reduced-order algebraic Riccati equa¬ 
tions corresponding to slow and fast time scales. The 
reduced-order algebraic Riccati equations obtained are non- 
symmetric. The Newton algorithm is very efficient for 
solving these nonsymmeUic algebraic Riccati equations 
since excellent initial guesses are readily available from 
the reduced-order, symmetric, algebraic Riccati equations 
that represent O(e) perturbations of the nonsymmeUic, 
reduced-order, pure-slow and pure-fast, algebraic Riccati 
equations. Due to complete and exact decomposition of the 
Riccati equation, and due to order-reduction, we have an 
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and x T (t ) = [*f (t) x \(/)]. The optimal closed-loop 
control law has the very-well known form 


u(x(t)) — —R 1 B t Px(t) — —Fx(t) (6) 
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where P satisfies the algebraic Riccati equation given by where L and II satisfy 


0 = PA + A t P + Q - PSP, 


Pi eft 

eif eft 


(7) 


ft/. ft tLii\ PL) - 0 (11) 

-H(T 4 + eftft) + ft + e(ft - T 2 L)H = 0 (12) 


The positive semidefinite stabilizing solution of the al¬ 
gebraic Riccati equation (7) exists under the standard 
stabilizability-detectability conditions [23]. 

Assumption 1.1: The triple (A, ft \/Q) is stabilizable 
and detectable. 

In the following we follow the results of [24] and 
show how to find the solution of (7) in terms of solutions of 
the reduced-order, pure-slow and pure-fast, algebraic Ric¬ 
cati equations. It is well known that the solution of the Ric¬ 
cati equation, can be obtained from the Hamiltonian matrix. 
It will be shown that for singularly perturbed systems, the 
Hamiltonian matrix retains the singularly perturbed form 
by interchanging and appropriately scaling some state and 
costate variables, hence it can be block diagonalized via 
the nonsingular transformations of [8], [25]. 

Partitioning and appropriately scaling p(t) as 
p T (t) = \pi(t) ep 2 (f) ] with pj (/) G = 1,2, and 

interchanging second and third rows in (4), we get 
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It is important to notice that (8) retains the singular per¬ 
turbation form. Also, the matrix ft is the Hamiltonian 
matrix of the fast subsystem, and it is nonsingular under 
stabilizability-detectability conditions imposed on the fast 
subsystem. 

Assumption 1.2: The triple (ft, ft, q 2 ) is stabilizable 
and detectable. 


It should be emphasized that the presented procedure 
is valid for both the so-called standard (matrix ft is non¬ 
singular) and nonstandard (matrix ft is singular) singu¬ 
larly perturbed linear control systems. Note that nonstan¬ 
dard singularly perturbed control systems are the recent 
trend in theory of singularly perturbed linear control sys¬ 
tems [20], [26]-[28], [39]. 


The celebrated transformation of [8], used for decom¬ 
position of linear singularly perturbed systems, is defined 
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The unique solutions of (11) and (12) exist for sufficiently 
small values of e under condition that ft is nonsingular, 
that is, under Assumption 1.2. These algebraic equations 
can be solved as linear algebraic equations using either the 
fixed-point algorithm of [29] or the Newton method of [9]. 
The corresponding algorithms for solving the L -equation 
are respectively given by 


L (i+ 1) = ft 0 ) + fft-ftO) ^ _ ft/ft :) 
ft- 1 !!,, i = 0,1,2,... 


(13) 


D {pl{i + l) + ift + lftW - 
l W = t~ 1 T 3 , ( = 0,1,2,... 
ftW = ft + e/ftft 

/ft = -e(ft - ftft ! )) , Q W = ft + elftlftiW 

(14) 

The Newton method converges quadratically, hence if it 
converges, it requires in average only four to five iterations. 
The fixed-point iterations converge linearly and sometimes 
require a lot of iterations. In addition, the L -equation can 
be efficiently solved by using the eigenvector method of 
[30] and the Taylor series expansions of [31]. Once the 
solution for the L -equation is obtained, the //-equation 
can be solved either directly as a linear Sylvester equation 
or recursively as 

Zft+!) =ft(ft + ftft)- 1 
+e(ft - fti)ft«(ft + eftft)- 1 (15) 

//'“'.. ft ft *. ( = 0,1,2,... 


The Chang transformation (10) applied to (8) produces 
two completely decoupled subsystems 
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The rearrangement and modification of the original vari¬ 
ables in (8) is done by using the permutation matrix ft 
of the form 
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Note that the inverse of E\ can be easily obtained analyti¬ 
cally, hence, this matrix is not numerically ill-conditioned 
with respect to the matrix inversion for small values of e. 

Combining (18) and (19), we obtain the relationship 
between the original and new coordinates as 
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and using (23) yield to two reduced-order, nonsymmetric, 
pure-slow and pure-fast, algebraic Riccati equations 
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where E 2 is a permutation matrix in the form 

-I ni 0 0 0 - 

771 0 0 I ni 0 

2 0 4 a 0 0 

.0 0 0 /„,. 


0 = P s a 1 - a 4 P s - a 3 + P s a 2 P s (30) 


( 20 ) 


( 21 ) 


0 — Pjb 1 — b 4 Pf — 63 + Pjb 2 Pf (31) 

with esr, bi, i = 1,2, 3,4, defined by (28)-(29). Let us point 
out that the nonsymmetric algebraic Riccati equation was 
studied by several researchers, see for example [32] and 
references therein. An algorithm for the solving general 
nonsymmetric algebraic Riccati equation was derived in 
[33]—see also [34], 

The pure-fast algebraic Riccati equation (31) is non¬ 
symmetric, but its O(t) approximation is a symmetric one, 
that is 


Since p(t) — Px(t), where P satisfies the algebraic Riccati 
equation (7), it follows that 
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In the original coordinates, the required optimal solution 
has a closed-loop nature. We have the same attribute for 
the new systems (16) and (17); that is 
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Then, (22) and (23) yield 
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Following the same logic, we can find P reversely by 
introducing 


PjA 4 + A^ Pf + Q 3 — PjS 2 Pf + O(e) — 0 (32) 

From (32) one can obtain an (){< ) approximation for Pf as 

pf ] A 4 + A t 4 P { p + Q 3 - pf } S 2 Pj 0) = 0 (33) 

The unique positive semidefinite stabilizing solution of 
(33) exists under Assumption 1.2. Hence, we have 
Pf = Pj 0) + O(e). The pure-slow algebraic Riccati equa¬ 
tion (30) is also nonsymmetric. It can be also shown that 
(30) is an O(e) perturbation of the first-order approximate 
slow algebraic Riccati equation obtained in [35] and [19] 

P( 0 ) A S + Aj + Q s - P'f'S s P ( s 0) - 0 (34) 

with P s = Ps° ] + O(e), where A S ,Q S , and S s can be 
found either using the methodology of [35] or from the 
results of [19] as 
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Note that from (11) and (28) we have 
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It is shown in [24] that the matrix inversions in (24) and 
(27) exist for sufficiently small values of e. 


Partitioning (16) and (17) as 
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The unique positive semidefinite stabilizing solution of the 
approximate slow algebraic Riccati equation (34) exists 
under the following assumption. 

Assumption 1.3: The triple (A s , \/Q~s) is stabi- 

lizable and detectable. 
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Note that in the case when the matrix A 4 is nonsingu¬ 
lar (standard singularly perturbed linear system). Assump¬ 
tion 1.3 can be replaced by a simpler assumption of the 
form [35], 

Assumption 1.3a: The triple (Ao, Do,qo) is sta- 
bilizable and detectable, with Ao — A\ — A 2 Af 1 As, 
Do — B\ — A 2 A 4 1 Do, qo — qi — 22^4 ^ As. 

Assumptions 1.2, 1.3, and 1.3a are the standard as¬ 
sumptions in theory of singularly perturbed linear control 
systems [4]-[5], 

Using the fact that the unique solutions of (33) and 
(34) exist, then by the implicit function theorem, [36], 
the existence of the unique solutions of (30) and (31) are 
guaranteed by the following lemma [24]. 

Lemma 1.1. Let Assumptions 1.2 and 1.3 be satisfied. 
Then, 3eo > 0 such that Ve < eo the unique solutions of 
(30) and (31) exist. 

Having obtained a good initial guess, the Newton type 
algorithm can be used very efficiently for solving (31). The 
Newton algorithm is given by 

if +1) (&r + h Pf) - (& 4 - Pf ] b^Pf +r) 

= bs + P { pb 2 pf\ i = 0,1,2,... 

with an initial guess obtained from (33). 

The pure-slow Riccati equation (30) can be solved 
by using the Newton algorithm also, with an initial guess 
obtained from (34). The Newton algorithm for (30) is 
given by 

if +1) (at + a 2 Jf°) - ( a 4 - Pfta 2 ) if +1) 

= as + Ppet 2 PP, ( = 0,1,2,... 


It is important to notice that the total number of scalar 
quadratic algebraic equations in (30) and (31) is n\ + n\. 
On the other hand, the global algebraic Riccati equation (7) 
contains f rii + n 2 )(rii + n 2 + 1 ) scalar algebraic equa¬ 
tions. Thus, the presented method can even reduce the 
number of algebraic equations if 

n\ + n 2 < + n 2 )(ni + n 2 + 1) (40) 

or 

(n 1 - n 2 f < rii + n 2 (41) 

which is the case when n\ and n 2 are close to each other. 

Using solutions of both pure-slow and pure-fast Ric¬ 
cati equations and formulas (23) and (28)-(29), we can get 
completely decoupled slow and fast subsystems in the form 

m(t) = («i + a 2 Ps)m{t) 

(42) 

«(<) = (61 + b * Pf)ti (t) 


of systems (filtering and/or control) can be completely 
performed at the local levels (slow and fast subsystems). 
The global solution in the original coordinates is then 
obtained at any time instant by using formula ( 22 ), that is 
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where P is obtained from (27). The use of the results 
given in (42) in optimal filtering (first of all) and control 
of singularly perturbed linear systems will be presented in 
the next sections. 

The quadratic performance criterion to be minimized, 
( 2 ), in the new coordinates is given by 
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The value of the above integral is obtained as 
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where the matrix V satisfies the algebraic Lyapunov equa¬ 
tion 
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which implies three independent, reduced-order, Lyapunov 
(Sylvester) algebraic equations 
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The interpretation of the result presented by (42) is 
that the optimal processing of information for this class 
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Formula (45) exactly decomposes slow and fast compo¬ 
nents of the optimal performance criterion. It can be con¬ 
cluded from (45) that the pure-slow component of the per¬ 
formance criterion is 0(1) and that the fast subsystem 
contributes only an O(e) to the performance criterion of 
a linear continuous-time deterministic system. 


B. Open-Loop Linear Control Problem 
The optimal open-loop control problem is a two-point 
boundary value problem with the associated state-costate 
equations forming the Hamiltonian system of linear dif¬ 
ferential equations. In this section, the two-point bound¬ 
ary value problem of linear singularly perturbed systems 
is transformed into the pure-slow and pure-fast, reduced- 
order, completely decoupled initial value problems by fol¬ 
lowing methodology of [37], By doing this, the stiffness 
(numerical ill-conditioning) of the original singularly per¬ 
turbed two-point boundary value problem is converted into 
the problem of an ill-defined linear system of algebraic 
equations. 

Consider the linear singularly perturbed control sys¬ 
tem (1). The associated performance criterion to be mini¬ 
mized over the time period from to to tf is defined by 
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where Qf is the terminal time penalty matrix. The open- 
loop optimal control problem of minimizing (47) along 
trajectories of dynamic system (1) has the solution given 
by (3)-(4) with boundary conditions given by [23] 


developed method is efficient for anO(t) accuracy only. In 
this section, the solution to the optimal open-loop control 
problem of singularly perturbed systems with an arbitrary 
order of accuracy is presented. 

Let us partition and appropriately scale the co-state 
vector p(t) as p T (t ) = [p{ ( t ) ep 2 (t) ] with pi (t) E 
and P 2 (t) E T'"*’. By interchanging second and third rows 
in the corresponding state co-state equations (4), we get 
the singularly perturbed system (8)-(9) with the boundary 
conditions 
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The original boundary conditions can be written in a com¬ 
pact form consistent to (8) as follows 
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In 

'2 - 



(53) 


The Chang transformation (10) applied to (8) produces two 
completely decoupled pure-slow and pure-fast subsystems 
defined by (16)-(18). The boundary conditions in the new 
coordinates corresponding to (16)-(18) are given by 


with 

M = 


M 


In o 

0 0 


*(f 0 ) 

4- N 

'x(tf)' 

p(to ). 

T 4 V 

P(t.f)_ 


(48) 


N = 


0 0 
L —Qf In J 

n — n i + no 


x(t 0 ) 

0 


(49) 

The terminal penalty matrix is appropriately partitioned as 


V(t o 

C(to) 


+ n 2 


' 1 ( 1/1 

.£(*/). 


Cl 


(54) 


where 

Mo .l/;T. ; . Ml = N 1 Ti 1 (55) 

Since solutions of (16) and (17) are given by 

ltd) = e l 71 :ui ;/(/,,) (56) 

£(t) = e HM + eLT 2 )(.t-t 0 )^t 0 ) (57) 


Q/ 


Qf i tQf 2 

eQ T f 2 eQf 3 


(50) 


The approximate optimal solution of the open-loop 
control for linear singularly perturbed systems has been 
studied in [18], where the problem order was reduced and 
the stiff problem was avoided successfully by using the 
classic approach based on the power-series expansions. 
The theory developed in [18] was based on the dichotomy 
transformation of [38], which requires the positive definite 
and negative definite solutions of the corresponding alge¬ 
braic Riccati equation. It was concluded in [18] that the 


we can eliminate rj(tf ) and £(i/) from (54), which leads to 


My + N 2 


JT 1 -T 2 L)(t J -t o) 


0 


0 

, 7(^4 + t-C7Vj(L — ' a) 


'/(M 


= Cl 


(58) 

The system of linear algebraic equations obtained, (58), is 
of the form 


a(e) 


V(i 0 ) 

€(*o) 


= Cl 


(59) 
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It is proved in [37] that «(t) is invertible, hence rj(t o) 
and 4(0 can be obtained from (59). The corresponding 
lemma of [37] is given below. 

Lemma 1.2. Under Assumptions 1.2 and 1.3, the 
matrix cv(e) is invertible. 

Now we are able to find i)(t) and 4(f) from (56) and 
(57). Using (18), we can get the values forpi(f) andp 2 (t). 
The costate variables p(t) and the optimal control law are 
therefore found. 

The only difficulty encountered in the procedure is 
to compute a(e) in the case when an ill-defined problem 
occurs either for e being extremely small or for (tj — to) 
being very large. Note that the matrix T 4 contains both sta¬ 
ble and unstable modes. In that case the O(e) -approximate 
results of [18] have to be used. 


C. Linear Kalman Filtering Problem 
In this section a method that facilitates complete decompo¬ 
sition of the optimal global Kalman filter of linear singu¬ 
larly perturbed systems into pure-slow and pure-fast local 
optimal filters both driven by system measurements is pre¬ 
sented. The method is based on the exact decomposition 
of the global singularly perturbed algebraic filter Riccati 
equation as presented in Section 1.1 and the duality prop¬ 
erty that exists between the linear-quadratic optimal filters 
and regulators. 

Filtering problem of linear singularly perturbed 
continuous-time systems has been well documented in 
the control literature [40]-[44]. In Haddad [40]-[42] the 
suboptimal slow and fast Kalman filters were constructed 
producing an O(t) accuracy for the estimates of the state 
trajectories, where a small positive singular perturbation 
parameter e represents the separation between slow and 
fast phenomena. In [43]-[44] both the slow and fast (local) 
Kalman filters were obtained with an arbitrary order of ac¬ 
curacy, that is O (t k ), where k stands for either the number 
of terms of the Taylor series [43] or the number of the 
fixed-point iterations [44] used to calculate coefficients of 
the corresponding filters. It is important to point out that 
the local slow and fast filters of [43]-[44] are driven by the 
innovation process so that the additional communication 
channels are required to form the innovation process. In 
the technique presented in this section, the local filters are 
driven by the system measurements only. In addition, the 
optimal filter gains are completely determined in terms 
of the exact pure-slow and exact pure-fast reduced-order 
algebraic filter Riccati equations. 

Consider the linear continuous-time invariant singu¬ 
larly perturbed stochastic system 


xi(t) = + A 2 x 2 (t) + G-xW^t) 

ex 2 = A 3 xi(t) + A 4 x 2 (t) + G 2 wi(t) 

with the corresponding measurements 

y(t) = C\Xi(t) + C 2 x 2 (t) + w 2 (t) 


(60) 


where Xf(t) 6 90 , i — 1,2, are state vectors, Wi(t) & W‘ 
are zero-mean stationary, mutually uncorrelated, white 
Gaussian noise stochastic processes with intensities 
Wi > 0, and y(t) £ JR’’ 2 are system measurements. In 
the following Ai,Gj,Cj , i — 1,2, 3 , 4 , j. = 1,2, are 
constant matrices. We assume that the system under con¬ 
sideration has the standard singularly perturbed form, [28], 
that is, the following assumption is satisfied. 

Assumption 1.4: The fast subsystem matrix A 4 is 
nonsingular. 

The optimal Kalman filter, corresponding to (60)-(71), 
driven by the innovation process, v(t), is given by 

x\(t) = A 1 x 1 (t) + A 2 x 2 (t) + 

ex 2 (t) = A 3 xi(t) + A 4 x 2 (t) + K 2 v(t) (62) 

v(t) = y(t) - CiXi(t) - C 2 x 2 (t) 


where the optimal filter gains K 1 and K 2 are obtained 
from (Khalil and Gajic 1984) 

A'i = {PifCJ + P 2F Cl)W 2 l 
K 2 ={ePj F ClFP 3 F C T 2 )WL l 

with matrices P iF , P 2F , and P 3F representing the positive 
semidefinite stabilizing solution matrix of the filter alge¬ 
braic Riccati equation 


AP F + P f A t - P F SP F + GW\G t = 0 (64) 


where 


A = 


A! 


S = C T Wp 1 C, P F = 


A-2 

U 4 


G = 


Pip 

P T 
1/2 F 


G\ 
\G 2 

P2P 

7-P3F 


(65) 


For the decomposition and approximation of the sin¬ 
gularly perturbed Kalman filter (62) the Chang transforma¬ 
tion have been used in [43]-[44] 


m W 


'I ni - eHL 

—ell 

•Cl (7) 

772 (f). 


L 

In 2 

/2 (t) 


where L and II satisfy algebraic equations 


( 66 ) 


A 4 L — A 3 — eL(Ai — A 2 L) — 0 
II .u + Ai- (II I.A 2 + (f,!i - A-,L)H = 0 


(67) 


The Chang transformation, defined by ( 66 ) and applied to 
(62) produces 

fh(t) = (Ai - A 2 L)j) 1 (t) + (A'i - IIIi 2 - eIILKi)v(t) 
£ 7 ) 2 (t) — (A 4 + eLA 2 )rj 2 (t) + ( l \ 2 + < 1.1\ i)c[1) 

( 68 ) 

In the new coordinates the innovation process is given by 


(61) 


7 


<•(/) yd) (Ci CiDind) 

-[C 2 + e(C 1 -C 2 L)II]r ] 2 (t) 


(69) 



Equations (67) are solvable and produce the unique 
solutions under Assumption 1.4. The algebraic filter Ric- 
cati equation (64) has the unique stabilizing solutions under 
the following assumptions. 

Assumption 1.5: The triple (A 4 ,G 2 , G 2 ) is stabilizable 
and detectable. 

Assumption 1.6: The triple (Ao,Go,Go) is stabi¬ 
lizable and detectable, with Ao — Ai 
Go = C\ — C 3 A 4 1 A 3 1 and Go = G\ — A 2 A 4 l G 2 . 

In the decomposition procedure given by (68)-(69) the 
slow and fast filters ( 68 ) require some additional commu¬ 
nication channels necessary to form the innovation process 
(69). In this section, we present a decomposition scheme 
of [45]—[46] such that the slow and fast filters are com¬ 
pletely decoupled and both of them are driven by the sys¬ 
tem measurements. This method is based on the pure-slow 
and pure-fast decomposition technique for solving the fil¬ 
ter algebraic Riccati equation of singularly perturbed sys¬ 
tems—derived by using duality between the optimal filters 
and regulators and the methodology presented in Section 
1.1. In that respect, we give an additional interpretation of 
the results presented in Section 1.1. 

Using (5)-(7), the optimal regulator gain is defined by 

F = [Fi F 2 ] 

= [R - 1 (Bj Pi + B^P?) R - 1 {tBj P 2 + Bj P 3 ) ] 

(70) 

The results of interest that we need, which can be deduced 
from Section 1.1, are given in the form of the following 
lemma. 

Lemma 1.3. Consider the optimal closed-loop linear 
system 

ii(t) = (Ai - BiFi)xi(t) + f.l 2 - BiF 2 )x 2 (t) 
ex 2 (t) = (A 3 — B 2 Fi)xi(t) + (.1.; — B 2 F 2 )x 2 (t) 


Under Assumptions 1.2 and 1.3 there exists a nonsingular 
transformation T 


such that 


'&(*)' 

— x 

Xl(t) 

&(t). 


X 2 (t). 


L{t) = («1 + a 2 P s )£, s (t ) 
ztf(t) = (b 1 + b 2 P f )i f (t) 


(72) 


(73) 


where P s and P; are the unique solutions of the exact 
pure-slow and pure-fast completely decoupled algebraic 
regulator Riccati equations (30)-(31). The nonsingular 
transformation T is given by 


T = (Hr + II 2 P) (74) 


Even more, the global solution P can be obtained from 
the reduced-order exact pure-slow and pure-fast algebraic 
Riccati equations, that is 


(75) 



rp. 

n 1 


r p. 

n 1 

P — i Ll 3 + Cl 4 

J s 

0 

< 

j f Sli + SI2 

- 1 s 

0 

< 

1 _ 


Known matrices if. i — 1,2, 3, 4, and II 1 , II 2 are given 
in terms of solutions of the Chang decoupling equations, 
and defined in (20) and (25). 

The desired slow-fast decomposition of the Kalman 
filter (62) will be obtained by producing a dual lemma 
to Lemma 1.3. Consider the optimal closed-loop Kalman 
filter (62) driven by the system measurements, that is 


x\ (f) = (Ai - KiCi)xi(t) + (A 2 - I\iC 2 )x 2 (t) 
+ Kiy(t) 

ex 2 (t) — (A 3 — I\ 2 Ci)xi(t) + (A 4 — K 2 C 2 )x 2 (t) 
+ K 2 y(t ) 


(76) 


with the optimal filter gains K\ and K-> calculated from 
(63)-(65). By duality between the optimal filter and regula¬ 
tor, the algebraic filter Riccati equation (64) can be solved 
by using the same decomposition method for solving the 
algebraic regulator Riccati equation (7) with 

A^A t , Q^GW 1 G t , F t = I\ 


z = BR~ 1 B t 


S^C 1 II, 'G 


(77) 


By invoking the results from Section 1.1 and using duality, 
the following matrices have to be formed 


Tip = 

■ AJ 

-GiWiGt 

c[w ., 'cr 

—Ai 

T 2 f — 

\ Al 

CyWyGl 

-CtWf 1 C 2 
— A-2 

T 3 f — 

At 

G 2 W 1 GJ 

CO 10 I 

d 

1 _ 1 

T 4 p — 

At 

ir 2 l (V 

-G 2 WiGt 

—A 4 


(78) 


Note that on the contrary to the results from Sec¬ 
tion 1.1, where the state-costate variables have to be 
partitioned and scaled as x T (t) — [xj(t)xt(t)] and 
p T (t) = p[ (/.) tp'l (/.)] , in the case of the dual filter vari¬ 
ables, we have to use the following partitions and scal¬ 
ing x T (t) = [xl(t)exl(t)] and p T (t) — [pj (t) p 2 (t)\. 
Since matrices Tip , T 2 p , T 3 p, T 4 p correspond to the 
system matrices of a singularly perturbed linear system, the 
slow-fast decomposition is achieved by using the Chang 
decoupling equations 

T 4 pM — T 3 p — c .1/ ( Tip — T 2 pM) — 0 

—N(T 4 p + cMT 2 p) + T 2 p + e(Tip — T 2 pM)N — 0 

(79) 

By using the permutation matrices dual to those from 
Section 1.1 (note E\p is different than the corresponding 
one from Section 1.1) 

0 
0 

jln2 
0 
0 
0 

In 2 

0 


Eif — 


E 2 f — 


Ini 

0 

0 

0 

rini 

0 

0 

L 0 


0 

In 1 
0 
0 
0 

Ini 

0 

0 


0 

0 

0 

In 2 

0 ■ 

0 

0 

In 2 ■ 


( 80 ) 


P = 



we can define 


and fii, fl 2 , fl 3 , ^4 obtained from 


lip — 


111 f n 2F 

n 3F n 4F 


= EJ f 


hn, - tNM -eN 


M l 2n% 

Then, the desired transformation is given by 

t 2 = + n 2 F p f ) 


E\ F 

(81) 

(82) 


LI = 


Qi Ll 2 
Q 3 Q 4 


= E 


hn, eN 

-M hn 2 - eMN 


E, 


-T 
2 F 


(91) 


A lemma dual to Lemma 1.3 can be now formulated 
as follows. 


The transformation T 2 applied to the filter variables as 


Vs(t) 

_ rp-T 

Xl(t) 

ft fit). 

— X 2 

X 2 {t) _ 


(83) 


produces 


\(ty 

_ rp-T 

A\ — h\C\ A 2 — K\C 2 

hfit). 

— 1 2 

_i(A 3 -A 2 C 1 ) \{Aa -K 2 C 2 )_ 


xT 


T 

2 


Vs(t ) 



y { t ) 


(84) 

such that the complete closed-loop decomposition is 
achieved, that is 


'/..(/) = (aiF + a 2 FP S F) T f] s ( t ) + K s y(t) 

efjf(t) = (bi F + b 2F P.fF) T rjf(t) + K f y(t) 
The matrices in (85) are given by 


a lF a 2F 

a 3F a 4F _ 
b 1 f b 2F 

p3F b 4 F 

' K, ' 

ll^/J 


— (Tif — T 2F M ) 


— (T^p + eMT 2F ) 



( 86 ) 


0 — P sF ai F — a^ F P sF — a 3F + P sF a 2 F P sF 
0 = PfFblF ~ biFPfF ~ b‘3F + Pfpb 2 FPfF 


(87) 


A method for solving nonsymmetric Riccati equations (87) 
is considered in Section 1.1. Note that the matrices needed 
for the O (e) approximate slow filter algebraic Riccati equa¬ 
tion dual to (34) and defined by 


Psf a ^f + A sF PTf + G s W ls G 


(o) 


_p(0) r T 

NF L S 


W. 


-1 

2s 


r < p(°) _ 


= 0 


( 88 ) 


can be obtained from [20] 

T t fti m— 1 m 

IF “ F 

(89) 

Even more, we can obtained the analytical expressions for 
C S ,G S , W\s, W 2s using the methodology of [43], It 
is important to point out that the matrix P F in (82) can 
be obtained in terms of P sF and Pf F by using formula 
(75) with 


AT sF 


-G s W ls Gj 


-G^w.-hh 


-A, 


sF 


Ps = PsF, Pj = PfF (90) 


Lemma 1.4: Given the closed-loop optimal Kalman 
filter (76) of a linear singularly perturbed system. There 
exists a nonsingular transformation (82), which completely 
decouples (76) into pure-slow and pure-fast local filters (85) 
both driven by the system measurements. The decoupling 
transformation (82) and the filter coefficients given in ( 86 ) 
can be obtained in terms of the exact pure-slow and pure- 
fast reduced-order completely decoupled algebraic Riccati 
equations (87). 

It can be seen from the previous analysis that the 
new filtering method allows complete decomposition and 
parallelism between pure-slow and pure-fast filters. 


D. Optimal Linear-Quadratic Gaussian Control 

In this section an approach for solving the linear-quadratic 
optimal Gaussian control problem of singularly perturbed 
continuous-time stochastic systems is presented. The algo¬ 
rithm proposed is based on the results presented in Sections 
1.1 and 1.3. It is shown that the optimal linear-quadratic 
Gaussian control problem takes the complete decomposi¬ 
tion and parallelism between pure-slow and pure-fast filters 
and controllers. 

Singularly perturbed linear-quadratic optimal control 
problem of stochastic continuous-time systems has been 
studied in the past by several researchers [41]-[44]. In this 
section, we present a completely new approach to the sto¬ 
chastic control of linear singularly perturbed systems that 
is pretty much different than all other methods used so far 
in the study the same problem by following the results of 
[45], [47], The approach is based on a closed-loop decom¬ 
position technique that guarantees complete decomposition 
of the optimal filters and regulators and distribution of all 
required off-line and on-line computations. As a matter of 
fact, the presented approach combines results presented in 
Sections 1.1 and 1.3 and uses the separation principle for 
linear stochastic control [23]. This decomposition allows 
us to design the linear controllers for slow and fast subsys¬ 
tems completely independently of each other and thus, to 
achieve the complete and exact separation for the linear- 
quadratic stochastic regulator problem. 

Consider the singularly perturbed linear stochastic 
system 


ii(t) = Aix^t) + A 2 x 2 (t) + BxuQ) + Gxw(t) 
ex 2 (t) = A 3 x i(t) + A$x 2 (t) + B 2 u(t ) + G 2 iv(t) (92) 
y{t) - CiXi(t) + C 2 x 2 (t) + w 2 (t) 
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with the performance criterion 

J = i lim ^^^ [z T (t)z(t) + w T (f)iiu(f)]df^ (93) 

where Xi(t) E = 1,2, comprise slow and fast state 

vectors, respectively, u(t) E is the control input, 
y(t) E 3x' r ’ 2 is the observed output, u’i(t) E 9J r ‘ are zero- 
mean stationary, mutually uncorrelated, Gaussian white 
noise processes with intensities 14'i > 0 and > 0, 
respectively, and z(t) E 9t‘, is the controlled output given 
by 

z(t) — DiXi{t) A D 2 x 2 {t) (94) 

All matrices are of appropriate dimensions and assumed 
to be constant. The optimal control law for (92) with the 
performance criterion (93) is given by 


As a result, the coefficients of the optimal pure-slow fil¬ 
ter are functions of the solution of the pure-slow algebraic 
Riccati equation only and those of the pure-fast filter are 
functions of the solution of the pure-fast algebraic Ric¬ 
cati equation only. Thus, these two filters can be imple¬ 
mented independently in the different time scales (slow 
and fast). It should be noted that the filtering method 
proposed for singularly perturbed linear stochastic systems 
allows complete decomposition and parallelism between 
pure-slow and pure-fast filters. 

The optimal control in the new coordinates is given 
by, [47] 


U Opt{t) 


—Fx(t) = FT'!, 


Vs(t) 

.%(*). 


~[F S 


F.f] 


Vs(t) 


( 100 ) 


u op t(t) = -Fixi{t) - F 2 x 2 (t) (95) 

where X\{t) and x 2 (t) are the optimal estimates of the state 
vectors X\ (f) and x 2 (t) obtained from the Kalman filter 

xi(t) = A 1 xi(t) + A 2 x 2 (t) + Biu(t) + Kiv(t) 
ex 2 {t) = A 3 xi(t) + A 4 x 2 (t) + B 2 u(t) + Ii 2 v(t) (96) 

v(t) - y(t) - C.'i .£,(/) - C 2 x 2 (t) 


where F s and Ff are obtained from 

[1% F f ] = FT^ = R~ 1 B T P(U 1F + U F2 P F f (101) 

The optimal value of J follows from the known formula 
[23] 

J opt = tv{PKW 2 K T + P f D t D} 

= tv{PGW 1 G T + P f F t RF } " U " ' 


The optimal regulator gains F\. F-> and filter gains A"i, K 2 
are given, respectively, by (70) and (63). The required 
positive semidefinite stabilizing solutions of the algebraic 
regulator and filter Riccati equations (7) and (64) can be 
obtained in terms of reduced-order, pure-slow and pure- 
fast, regulator and filter, algebraic Riccati equations, re¬ 
spectively, given by (30)-(31) and (87). 

The optimal global Kalman filter (96) can be put 
in the form in which the filter is driven by the system 
measurements and optimal control inputs, that is 

xi(t) = (Ai - /\ if.'i).(;,(/) + (A 2 - I\iC 2 )x 2 (t) 

+ A;«'(/) + Kiy(t) 

ex 2 (t) - (A 3 - K 2 Ci)xi(t) + {A 4 - I\ 2 C 2 )x 2 (t) 

+ B 2 u(t) + I\ 2 y(t) 


It is known from Section 1.1 that there exists a nonsingular 
transformation defined by (82) such that (97) is decoupled 
into pure-slow and pure-fast local filters both driven by 
system measurements and system control inputs 

fj s (t) - (cii F + a 2F P sF ) T r) s (t) + B s u(t) + K s y{t) 

eri f (t) = (b 1F + b 2F P fF )‘ //;(/) + B f u(t) + K f y(t) 

(98) 

The pure-slow and pure-fast filter gains, K s ,Kj, are de¬ 
fined by (86). The pure-slow and pure-fast system input 
matrices are given by 


B s 
7 B S 


= T 


-T 



(99) 


n. Hoc-OPTIMAL CONTROL AND FILTERING 
Singularly perturbed /Loo -optimal linear-quadratic control 
and filtering problems have been studied in the past by 
several researchers [21]-[22], [48]-[54]. Related problems 
for singularly perturbed differential games and disturbance 
attenuation have been considered in [55]-[58]. 

In this section we study the algebraic Riccati equa¬ 
tion of singularly perturbed Z/oo -optimal linear-quadratic 
control problems by generalizing the results of [24] and 
present an efficient reduced-order algorithm that removes 
ill-conditioning of the original problem. Another approach 
to decomposition of the algebraic Riccati equation for the 
same class of systems, based on a transformation derived in 
[13], has been considered in [21]-[22]. However, the prob¬ 
lem of deriving an algorithm for solving the corresponding 
algebraic Riccati equation is not addressed in [21]-[22], 

It is well known [4]-[5] that the singularly per¬ 
turbed algebraic Riccati equation is ill-conditioned. In 
this section, we show how to exactly decouple the alge¬ 
braic Riccati equation of //qo- optimal control of singu¬ 
larly perturbed systems in terms of pure-slow and pure- 
fast, reduced-order, well-conditioned , II x -algebraic Ric¬ 
cati equations. We also establish conditions that allow 
such a decomposition, and formulate the corresponding al¬ 
gorithm. Even though, the obtained reduced-order IIoo- 
algebraic Riccati equations are nonsymmetic, they are effi¬ 
ciently solved in terms of Lyapunov iterations by using the 
Newton method. The iterative algorithm of [59], also given 
in terms of Lyapunov iterations, is used to obtain numeri¬ 
cal solutions of the corresponding reduced-order, slow and 
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fast, symmetric, II x algebraic Riccati equations, which 
contain indefinite matrices in quadratic terms, and whose 
solutions produce excellent initial guesses for the Newton 
method. 

The results presented in this section will facilitate ex¬ 
act and complete time-scale decomposition of -optimal 
control and filtering tasks of singularly perturbed systems, 
and reduced-order parallel processing of all off-line and 
on-line computational requirements. 


A. Hoo—Optimal Linear Control 

The linear singularly perturbed control system under dis¬ 
turbances is described by 


xx(t) 

ex 2 (t)\ 


Ai 

^3 


^2 

A 4 


Xl(t) 

X 2 (t)\ 


B 1 

B 2 


t(t) + 


D 1 

D 2 


0 ) 

"(103) 


where x\ (f) E 1 ,x 2 (l) E 5ft ” 2 are, respectively, system 
slow and fast state space variables, u(t) E 3t™ is a control 
input, w(t) £is a system disturbance, and e is a small 
positive singular perturbation parameter. The performance 
criterion to be minimized is given by 


OO 

,J—^J x‘ (l)Qx(l) — a 1 U)ltu(t) dt. Q > (1. li > (1 

(104) 

The /Too -optimal control problem associated with 
(103) and (104) has a solution given in terms of solution 
of the following algebraic Riccati equation [60]-[62] 


A J P+PA+Q-P S’ - —Z P = 0, P = 

* '-wZ 1 


Pi eP 2 

eP 3 

(105) 


cPj eP 3 


where 


A = 


Ai 


A-2 
3 -/U 


%■ = 


s = 

1 z! I z- 


ip. 


iP? 4P 


2 

tPs 


> 0 


> 0 


J 2 73-^3 
r>T c _ n d- 1 nT 


ISi = B 1 R~ l Bi, P 2 =PiP“ i P 2 i , S 3 = B 2 R~ 1 Bj 


Z\ — D\Lj\ , Z 2 — DiD 2 , z / 3 


Z 3 — D 2 D 2 


(106) 

and 7 is a real positive parameter that represents an optimal 
disturbance attenuation level in the sense 


inf sup 

u (f) w(t) 


V 7 1 

IK 0 IIJ 7 


(107) 


The optimal controller that guarantees the 7 level of op¬ 
timality is given by 


■u ;op t(l) — R 


B 1 


Px(t) 


(108) 


zero-sum differential games [63], stabilization of uncertain 
systems [64]-[65], disturbance attenuation problems [ 66 ], 
and decentralized stabilization [67]. 


B. Singularly Perturbed II^-Algebraic Riccati Equation 
The Hamiltonian form corresponding to the li algebraic 
Riccati equation (105) is used in further analysis. This 
form is given by 


'i(t)' 


N] 

Hl- 

1 

03 

1 

x(ty 

pit ). 


-Q ~A T \ 

pit ) . 


with 

p{t) = Px{t) (110) 

Our goal is to find the solution of (105) in terms of 
solutions of the reduced-order, pure-slow and pure-fast, 
Poo-algebraic Riccati equations by following the method¬ 
ology of [24] and [ 68 ]. In addition, we establish conditions 
for such a decomposition, and formulate the correspond¬ 
ing algorithm. 

By partitioning the costate vector p(t) as 
p(t) = \pi(t) ep 2 (t)] with pi(t) E IR ni , p 2 {t) E and 
interchanging the second and third rows in (109) we get 


with 





~xi (t)- 

piit) 


T 1 T 2 


Pi(t) 

■e-A.l) 


.\t 3 M 


X 2 (t) 

-Mt)- 



.p 2 (t). 


Ti = 


A\ 

—Qi 


(pi 7 U,) 

‘ -AT 


t 2 


•'2 — — ^^ 2 ) 

-Q 2 -Al 


-1 

CO 

-(s 2 -^Z 2 ) 

I-Q 2 

-A? 


( 111 ) 


( 112 ) 


A 4 

-(s 3 -±z 3 ) 

_—Q3 

' -AT 


It is important to notice that (111) retains the singularly 
perturbed form. In the following, in order to be able to 
apply the Chang transformation to (111), we need nonsin¬ 
gularity of the fast subsystem matrix 7 4 . It is established 
in [ 21 ]-[ 22 ] that the matrix T 4 is nonsingular under the 
following assumption. 

Assumption 2.1: The triple {A 4 , B 2 , \/Q 3 ) is con¬ 
trollable and observable. 


Applying the Chang transformation to (111) we get in 
the new coordinates two independent pure-slow and pure- 
fast subsystems 


m (t)' 


a i 

«2 

vi(ty 

M f ). 


as 

CI 4 

M l ). 




T 2 L) 


vi{ty 
m it). 
(113) 


The algebraic Riccati equation (105) with an indefinite 
coefficient matrix in the quadratic term appears also in 
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-1 


Ci (O’ 


61 b 2 

Ci (ty 

C 2(f). 


63 64 

C 2 (t). 


(T4 + <■■1-1-J) 


'Cl (t) 
C 2(0 


(114) 

where the matrix L is obtained from the Chang transforma¬ 
tion equation (11) . Note that one can also apply to (111) 
the new version of the Chang transformation derived in 
[25] that produces complete independence between the L 
and II equations. However, in that case, the II equation is 
weakly nonlinear. The unique solutions of the correspond¬ 
ing equations (11)-(12) exist for sufficiently small values 
of e under the assumption that the matrix T 4 is nonsingular 
(by the Implicit Function Theorem). 


The relationship between the new and old state vari¬ 
ables is determined by the Chang transformation as 






'*1 (O' 


'*1(0' 

r](t) 


I — ell L -ell' 


Pi(t) 

— To 

Pl(t) 

C(0j 


L 1 


C-l CN 

^ a, 

— -L 3 

<M Cl 


(115) 

The relationship between the original and new coor¬ 
dinates is given by 




_? n(0' 


'*1 (0 ■ 

Ci (0 

- El 

m{t) 


pi(t) 


— ^2 

Ci (0 

— P ^2 ± 3 

*2 (0 

-C 2 (0 - 


Lc*(0 J 


-ep 2 (t). 


= Ei, T 3 £i 


"*( 0 " 

— If 

'*( 0 ‘ 


iii n 2 

'x(t)' 

P( 0 . 


P(t). 


1 I 3 1 I 4 

p(t). 


(116) 

where the permutation matrices E\ and are defined in 
(19) and (21). 


Now we can proceed like in Section 1.1, that is, along 
the lines of (22)-(31). In the new coordinates, the state and 
costate equations are related by 


Also, we can find P in terms of P s and Pf as 


P = 


^ 1^3 + El 4 


Ps 

0 


0 

Pf. 


where 


+ fl 2 


Ps 

0 



( 120 ) 


n = 


Q 1 

H 3 


1^2 

H 4 


= e^ 1 t^ 1 E 2 = n _1 


( 121 ) 


It can be shown that the inversions defined in (119) and 
(120) exist for sufficiently small values of the singular 
perturbation parameter e since the corresponding matrices 
are equal to I + O(e). 

It is interesting to point out that J/qo- algebraic Riccati 
equations (118) are nonsymmetric, but their O (c ) pertur¬ 
bations are symmetric. Namely, by closely examining the 
coefficients in (114), the pure-fast II 00 -algebraic Riccati 
equation is represented by 

Pf A 4 + A 4 Pf + Q 3 — Pj ^£3 — —Z^J Pf + 0{e ) — 0 

( 122 ) 

It can be observed from (120) that 


P = 


Ps 

0 


+ 0(e) 


(123) 


It is known from [49] that the nature of the solution matrix 
of (105) is 


Pi+0(e) e(P 12 + 0(e)) 

e(P ? 2 + 0(e)) e(P 2 + 0(e)) 

Pi = Pf ■ P'i = Pi 


(124) 


m(t) 


■ 

O 

qC 

m(t) 

[c 2 (0 J 


O 

Lci(o J 


where Pi satisfies the symmetric slow II ^ -algebraic Ric- 
(117) cati equation. It follows from [49] and (123)—(124) that 


Using (117) in (113)-( 114) we get two reduced-order non¬ 
symmetric, pure-slow and pure-fast, Hoo -algebraic Riccati 
equations, respectively given by 


0 = P s ai - a 4 P s - a 3 + P s a 2 Ps 

(118) 

0 = Pfbi — b 4 Pf — 63 + Pf & 2 Pj 

The reduced-order algebraic nonsymmetric Riccati equa¬ 
tions can be solved by using the eigenvector method in 
terms of eigenvectors spanning the stable subspace, [23]. 
Another approach for solving equations (118), which is 
more in the spirit of theory of singular perturbations, is 
given below. 

By using the same methodology as in Section 1.1 we 
get 

= (n 3 + n 4 P)(n 1 + n 2 P)“ 1 (ii9) 


p s 0 
.0 P.,. 


P S A S + AjP s + Q s — P s ^iS s — —Zg^j P s + O(e) — 0 

(125) 

From (122) and (125) one can obtain O (t ) approximations 
for P s and Pf equations by solving the following II oo 
algebraic Riccati equations 


Pi 0) Ag + AjP ( s 0) + Q S - I* (s. - Zg'j Pf' = 0 

7 (126) 

pf ] A 4 + A T 4 pf ] + Q 3 - P f (0) (^3 - \,Z^j if - 0 

(127) 

The unique positive semidefinite stabilizing solution of 
(127) exists under Assumption 2.1, [59]. The unique 
positive semidefinite stabilizing solution of (126) exists 
under the following assumption, [59], 

Assumption 2.2. The triple (A s , B s , s/Q s ) is stabiliz- 
able and detectable. 
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Matrices A s , B s ,Q S , can be derived either by using 
the methodology of [49]-[50] or even in a simpler manner 
from the results of [20] as 


' A, -($-4,2.) 

-Qs -AJ 


= T 1 -T 2 T^ 1 T 3 


(128) 


An important feature of equations (126)-(127), which 
distinguishes these equations from the standard algebraic 
Riccati equation of the linear-quadratic optimal control 
problem is that the quadratic terms in (126)-(127) have in¬ 
definite coefficient matrices. The algorithm of [59], given 
in terms of Lyapunov iterations, converges globally to the 
positive semidefinite stabilizing solution of (126)-(127) un¬ 
der Assumptions 2.1 and 2.2. It has been demonstrated in 
[69] that the Lyapunov iterations are very efficient numer¬ 
ical tool for solving many nonlinear algebraic equations 
arising in optimal control and filtering problems. Using the 
algorithm of [59], equation (127) is solved by performing 
the following Lyapunov iterations 


jf“*” (A - syf’) 

+ (-4 

(129) 

with the initial condition obtained from the standard alge¬ 
braic Riccati equation 


P f (0)(O, A4 + A^M 0)(O, +Q 3 -U f ^0)(O) ^U, (0)^O, =0 (130) 


This choice of the initial condition is an interesting feature 
of the algorithm of [59], and it is important for the effi¬ 
ciency of the overall algorithm for solving the singularly 
perturbed II X -algebraic Riccati equation. Having obtained 
an approximate solution P | 0) = Pf + O(t), we can imple¬ 
ment the Newton method for solving the pure-fast algebraic 
Riccati equation given in (118) since a good initial guess 
is available. The Newton method leads to the following 
Lyapunov-like (Sylvester) iterations 

if +1) (&l + hPf) ~ (h - /f%)/f~‘ 

= h + pj%Pp <131) 

and converges in only few iterations. 

Similarly, the algorithm of [59] is applied for solving 
(126) as 

Pi°) (,+1) (A s -S s pf' ) ) 

+( 4 , ~ s s pi o) ^y p^ ,+i) 

= ~(q, + P ( s °^S s pW M + -i J pW c<) Z,pj$ w ^ 

(132) 


with the initial condition obtained from the standard slow 
algebraic Riccati equation 

P^ {0} A s +AjP ( /^+Q s -P^ 0) S s P ( s ° )W =0 (133) 

Having obtained an approximate solution Ps° ] — P s + 
0(e), we can implement the Newton method for solv¬ 
ing the corresponding pure-slow algebraic Riccati equa¬ 
tion defined in (118) since a good initial guess is available. 
The Newton methods leads to the following Lyapunov-like 
(Sylvester) iterations 

if +1) (a, + a 2 U«) - (a 4 - Pf >a 2 ) if* 1 ) ^ 

= a 3 + if ) a 2J pW 


which converge quadratically to the required solution. 

C. Singularly Perturbed Ilra-Optimal Linear Filtering 
The Kalman filter has been used since 1961 in all areas 
of control system engineering [70]. It has been also used 
in signal processing (see for example, [71]-[72] and ref¬ 
erences therein), image processing, communications, and 
economics. In this section we present a method that al¬ 
lows complete time-scale separation and parallelism of the 
//oo-optimal Kalman filtering problem for linear systems 
with slow and fast modes (singularly perturbed linear sys¬ 
tems). The algebraic Riccati equation of singularly per¬ 
turbed //oo -Kalman filtering problem is decoupled into 
two completely independent, reduced-order, pure-slow and 
pure-fast, E^ -algebraic Riccati equations by using the 
methodology from the previous section. The corresponding 
//oo-Kalman filter is decoupled into independent reduced- 
order, well-defined, pure-slow and pure-fast, Kalman fil¬ 
ters driven by system measurements. The proposed exact 
closed-loop decomposition technique produces a lot of sav¬ 
ings in both on-line and off-line computations and allows 
parallel processing of information with different sampling 
rates for slow and fast signals. 

During the last fifteen years the //oo -optimization 
became one of the most interesting and challenging areas of 
optimal control and filtering theories and their applications. 
The main advantage of the E^ -optimization is that such 
obtained controllers and filters are robust with respect to 
internal and external disturbances. In the case of Kalman 
filtering, the additional advantage of the //oo-Kalman filter 
over the standard Kalman filter is that the former one does 
not require knowledge of the system and measurement 
noise intensity matrices—data hardly exactly known. 

It is known that the singularly perturbed Kalman filter 
is numerically ill-conditioned due to coupling of the slow 
and fast modes (signals). Hence, the main goal in theory 
of singular perturbations is to decouple (separate) the slow 
and fast signals and process them independently. Diffi¬ 
culties encountered with the full-order E^ -Kalman filter 
of singularly perturbed linear systems are in the facts that 
the corresponding algebraic filter Riccati equation is also 
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ill-conditioned and that it contains an indefinite coefficient 
matrix multiplying the quadratic term (which makes this 
equation much more difficult for studying than the cor¬ 
responding one of standard singularly perturbed optimal 
filtering problems). 

In the previous section the algebraic regulator Riccati 
equation of II^ optimal linear-quadratic regulator prob¬ 
lem is decomposed into reduced-order, pure-slow and pure- 
fast, algebraic regulator Riccati equations. In this section, 
we extend those results to the decomposition of the corre¬ 
sponding algebraic filter Riccati equation and use them to 
decompose the II a 0 singularly perturbed Kalman filter into 
independent, well-defined, reduced-order, Kalman filters. 
The filters obtained are completely independent and can 
work in parallel. Each of them can process information 
with different sampling rate—the fast filter requires small 
sampling period and the slow one can process information 
with relatively large sampling period. 

Consider the linear singularly perturbed system 

•C 1 (/) = .1 !.£,(/) + A 2 x 2 (t) + Diw(t) 
ex 2 {t) = i ( /) + A 4 x 2 (t) + D 2 w(t) 

with the corresponding measurements 

y(t) = C 1 x 1 (t) + C 2 x 2 (t) + v(t) (136) 

where x\(t) 6 3f ni and x 2 (t) £ 3J" 2 are slow and fast state 
variables, respectively, w(t) £ 5R ri and v(t) £ 5A 2 are 
system and measurement disturbances, and y(t) £ 5ft r2 are 
system measurements. Ai,Dj,Cj , i — 1,2,. 3,4, j = 1,2, 
are constant matrices of appropriate dimensions, e is a 
small positive singular perturbation parameter. 

In this section we design a filter to estimate system 
states x\(t) and %(/). The states to be estimated are given 
by a linear combination 


z(t) = GiXi(t) + G 2 x 2 {t) (137) 


The estimation problem is to obtain an estimate iff) of 
z(t ) £ using the measurements y(t), [72]-[74]. The 
measure of the infinite horizon estimation problem is de¬ 
fined as a disturbance attenuation function 


J = 


OO 

f \\z(t) - z{t)\\ 2 R dt 
_0_ 

c° , \ 

I (lkWII^-i + IK0lt£-i)* 


(138) 


where R > 0, IK > 0 and V > 0 are the weighting 
matrices to be chosen by designers. The Arc-filter is to 
ensure that the energy gain from the disturbances to the 
estimation errors, z(t) — z(t), is less than a prespecified 
level j 2 . That is. 


singularly perturbed linear systems, driven by the innova¬ 
tion process, is given by [46], [72] 

xi(t) = Axi^t) + A 2 x 2 (t) + I<iP(t) 
ex 2 (t) = .lyxqf/) + A 4 x 2 (t) + K 2 v{t) (140) 
v(t) = y(t) - Cixi(t) - C 2 x 2 (t) 


where the filter gains A i and K 2 are obtained from 

A'r = {PifCI +P 2 F Cj)V ~ 1 
K 2 = {ePj F Cj + PzfC^V - 1 


with matrices I\f- P'zf , and P F representing the positive 
semidefinite stabilizing solution of the following algebraic 
Riccati equation [72]-[73] 


AP F + P F A T - Pf{c t V~ 1 C - X t G t RG^jP f 


+DWD 1 = 0 


(142) 


where 

A = 


A\ 

T^3 


A 2 

M4 


, D — 


Di 


,Pr = 


PlF P 2 F 

PIf 7 P 3F 


c = [Cl c 2 ], G = [Gi G 2 ] 

(143) 

In order to form the innovation process defined in 
(140), communications of the filter estimates are required, 
thus additional communication channels are necessary. In 
the following, we will achieve the slow-fast /Ax, -filter 
decomposition in which both filters are directly driven by 
the system measurements and thus, we will eliminate the 
need for communication of estimates. The problem of 
solving the II 00 singularly perturbed algebraic filter Riccati 
equation (142) will be solved by using duality between the 
optimal filters and regulators and the algorithm from the 
previous section. 

The desired decomposition of the H 00 filter (140) will 
be obtained by first producing dual results to (118), (120). 
Consider the optimal closed-loop filter (140) driven by the 
system measurements 


&i(t) - (Ai - A 1 C’i)4i(f) + (A 2 - KiC 2 )x 2 {t) 
+Kiy{t) 

ex 2 (t) = (A 3 - Ii 2 Ci)xi(t) + (A 4 - K 2 C 2 )x 2 (t) 

+A 2 y(t) 

(144) 

with the optimal filter gains K\ and AT calculated from 
(141)-( 143). By duality between the optimal filter and 
regulator, the filter algebraic Riccati equation (142) can 
be solved by using the same decomposition method as the 
one used for solving (105) with 


sup J < J 2 

W ,V 


(139) 


A^A T , Q^DWD t 1 f t 


A = 



S = BR-[ l B T C T V~ 1 C, dd t ^g t rg 

(145) 


where "sup" stands for supremum and j 2 is a prescribed 
level of noise attenuation. The IIoa -filter associated with 
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By invoking results from Sections 1.3 and 2.2 and using 
duality between the optimal linear-quadratic controllers and 
optimal Kalman filters, the following matrices have to be 
formed 

-(cfV-'C!- ^GjRG i y 

—A\ 


Ti = 


A? 

DiWDi 


where, the pure-slow and pure-fast, well-conditioned, 
reduced-order, algebraic H z . filter Riccati equations are 
given by 


P s F a 1 — O-aPsF — a 3 + PsF a 2PsF — 0 
PfFb 1 — b 4 Pfp — 63 + PfFb2PfF — 0 


with 


(150) 


T 2 = 


n = 


t 4 = 




-DiWD z 


A% 


-D 2 WDj 


Ai 

D-, (1 D'f, 


-(cfV-%-^GjRG 2 ) 

— A 2 


—A 3 


a 1 a 2 
a 3 a 4 


= {T l -T i M), I 1 l 2 = (T 4 + eAIT 2 ) 

0 3 

(151) 

The V-i. i = 1,2, 3,4, matrices in (149) are defined by 


= 


&IF £lnp 
F 1^4 F 


(cfv-'Ci- ^QIrgA 

E7 1 T7 1 En = E7 1 

I 

eN 

-a 4 ' 


—M 

I - eMN _ 


(152) 


En 


(146) 

It can be shown after some algebra that matrices 
(Ti, T 2 , T 3 , T 4 ) comprise the system matrix of a standard 
singularly perturbed system, namely 


A' 



-x x - 

Pi 


Ti T 2 


Pi 

x 2 


. 7 T 3 iT 4 _ 


x 2 

-P2- 



-P2 - 


Note that in contrast to the results of Section 2.2, where 
the state-costate variables have to be partitioned as 
x T = \x\ x 2 ] and p T = [p{ ep 2 ], in the case of the 
dual filter variables, we have to use the following parti¬ 
tions x T — [Vf e% 2 ] and p T = [p{ p 2 ]. Since matrices 
Ti, T 2 , T 3 , and T 4 correspond to the system matrices 
of a singularly perturbed linear system, the slow-fast de¬ 
composition of (147) can be achieved by using the Chang 
decoupling transformation obtained from algebraic equa¬ 
tions dual to (11)-(12). The unique solutions of these 
equations exist, by the implicit function theorem, for e 
sufficiently small, under the assumption that the matrix 
T 4 is nonsingular. Using the results of [21 ]-[22] and 
duality between optimal linear-quadratic regulators and 
Kalman filters given in (145), it follows that this matrix is 
nonsingular under the following assumption. 


The permutation matrices Mi and E 2 are defined in (80). 

It can be shown that one can obtain O(e) approxi¬ 
mations for Pg.jp and Pfp by solving the following II ^ 
symmetric algebraic filter Riccati equations 


—P. 


P^A* + A,P% + D.W.Dj 


(0) / ,.j ,, 1 


Qi Vr l C a - - r7 Gi R s G s }P?J = 0 


(153) 


pf^A T 4 + A 4 P$! + DnWDl 

P}V (cl V- 1 ^ - ^G*RG 2 ) pj°J = 0 <154) 

The newly defined matrices appearing in (153) are obtained 
from 


aJ -(cjvr'Cs- ±g t s r s g s ) 

-D S W S DJ -A. 

- / 'i W4% 


(155) 


An important feature of equations (153)—(154), which dis¬ 
tinguishes these equations from the standard algebraic filter 
Riccati equation, is that the quadratic terms have indefinite 
coefficient matrices. 


Assumption 2.3: The triple (A. 4 ,C 2 ,-D 2 ) is control¬ 
lable and observable. 

The required Chang decoupling transformation is 
given by 


T 4 


I - eNM (.V 

M I 


(148) 


where N and M satisfy algebraic equations (11)-(12). 
Then, by duality, from Section 2.2, we have 


Pf — -hp + 


x Hi f + H2 f 


4 F 


p. 


PsF 0 

0 P fF j 
0 


sF 

0 P 


JF J 


(149) 


The algorithm of [59] developed for solving the 
II^ -algebraic Riccati equations in terms of Lyapunov it¬ 
erations, converges globally to the positive semidefinite 
stabilizing solution of (153)-(154) under the following 
stabilizability-detectability assumptions. 

Assumption 2.4: , \JCJ V s ~ 1 G s , y/D s W s DJ ^ 

is stabilizable and detectable. 

Assumption 2.5: The triple (. l.r/jfT- /-V! is stabiliz¬ 
able and detectable. 

Note that Assumption 2.5 is weaker than Assumption 
2.3, hence, it is sufficient to use in this section only As¬ 
sumptions 2.3 and 2.4. Also, Assumption 2.4 can be writ¬ 
ten in a simpler form requiring that the triple (A S ,C S , D s ) 
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is stabilizable-detectable. However, in that case, one has 
to find C s and D s matrices explicitly. This can be done by 
using the procedure of [49]-[50] for forming the reduced- 
order slow approximate system. 

Using the algorithm of [59], equation (154) is solved 
by performing the following Lyapunov iterations 

Pj°/' +1> (A 4 - 1 /- l C 2 pf^) T 

+ (,i 4 - (f v~ 1 c 3 pjf > )rjf +1) 

= ~(d 2 wd% + (156) 

^ p(®)*'*riT nrt p( 0 )^ 

j2 r fF °2 ntr 2 P fF 

with the initial condition obtained from the standard alge¬ 
braic filter Riccati equation 


method for solving the corresponding slow Riccati 
equation defined in (150) since a good initial guess is 
available. The Newton methods leads to the following 
Lyapunov-like (Sylvester) iterations 

P s*F^ (“1 + ^Psf) ~ (“4 - PsF a 2^Ps l F 1] 

— n -I- n 

— a 3 + ^sF a ^^sF 

with pfp obtained from (159). The iterative scheme (161) 
converges quadratically to the required solution. 

Cl. Slow-Fast Decoupling of 11-Optimal Linear Filter 
It is interesting to point out that for the standard (classical) 
Kalman filtering, the transformation that relates the old 
and new coordinates defined by 


Fjf'AS + Ajff' 


~P 


4 

(0)W 


.fF 


+ d 2 wd 1 2 
cJv- 1 c 2 p^°/ 0) =0 


(157) 


where 


r... (flip + n 2 fPf) 


(162) 


This choice of the initial condition is an interesting fea¬ 
ture of the algorithm of [59], and it is important for the 
efficiency of the overall algorithm for solving the singu¬ 
larly perturbed II oo -algebraic Riccati equation. Having 
obtained an approximate solution pjp = PfF + 0(e), we 
can implement the Newton method for solving the pure- 
fast algebraic Riccati equation given in (150) since a good 
initial guess is available. The Newton method leads to the 
following Lyapunov-like (Sylvester) iterations 


P^ (hi + & 2 pg) - (& 4 - Pf%)P 


0+i) 

fF 


= b 3 + Pf)b 2 pfl 


(158) 


III# 

II 2 F 


7 - eNM 

—eN " 

E, 

II 3 .F 

II 4 .F 

2 

M 

I 

I 


(163) 

is used to decouple both the algebraic filter Riccati equa¬ 
tion and the Kalman filter into independent pure-slow and 
pure-fast components [46], However, in the case of the 
IIoo -Kalman filtering the similarity transformation 


v*{t) 

1 

+ 

1 

Xl(t) 

Vfit). 

1 — 

*2(7. 


(164) 


does not produce in the new coordinates the optimal pure- 
slow and optimal pure-fast Kalman filters, that is 


with P^J obtain in (156), and converges in only few 
iterations. 

Similarly, the algorithm of [59] is applied for solving 
(153) as 


P. 


+ 


sF ‘ +1) 

(A-cjv-'QMpyT 11 

■ [d s w s dJ + cj v-'c, ptf' 

_^ p(Q)^ f^T JD (-1 p( 0 )^ 

r sF Il s^s r S F 


) 


(159) 


with the initial condition obtained from the slow algebraic 
Riccati equation 


pf'.g+A.Pp" 


sF 


FsF L s V s 


+ D s W s Di 
(<$<“> _ 


(160) 


= 0 


Having obtained an approximate solution 
l‘[ { p = P s p + O(e) we can implement the Newton 


'liA.tV 

— r _1 

A\ — K\C\ A 2 — K\C 2 

M*): 

— 1 

_\{A 3 -K 2 C 1) Ml; K 


xT 


Vs(t) 

fit (7 . 


+ r _1 



y(t) 


(165) 

does not lead to a block diagonal filter matrix in the new 
coordinates. The reason for this is inconsistency lies in the 
fact that the “closed-loop II oo -filtering problem matrix” is 


A — P F Lc' r V l C - -G T RG\ 

V T ) (166) 

■ • .1 l\C ~^P f G t RG 
T 


This matrix is indeed block diagonalized by the similarity 
transformation T. However, the IIoo optimal Kalman filter 
defined in (144) has the feedback matrix given by 


A - P f C t V~ 1 C = A-KG 
A\ — /fi Ci A 2 — K\G 2 

7 ( 41.3 — K 2 Ci) 7 ( 4(4 — K 2 G 2 ) 


(167) 
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This singularly perturbed matrix can be diagonalized by 
using another Chang transformation of the form 



7 - cHL 

-eH' 

_1 

' I eH 

T f = 

L 

I 

T 1 — 

> A F ~ 

-L I-eLH 


i- j L. _i 

(168) 

where L and H matrices satisfy the Chang decoupling 
equations 


(A 4 -Iy 2 C 2 )L-(A 3 -Iy 2 C i) 

-e[(^r - A'rA) - (A 2 - K t C 4 )l._ - 0 

II (- l-i — K 2 C 2 ) + (A 2 — RiC 2 ) (169) 

-cHL(A 2 - K\C 2 ) 

T e[(A 4 - KiCi) - (A 2 - KiC 2 )LJI = 0 

The unique solutions of these equations exist under the 
assumption that the matrix A 4 — Iy 2 C 2 is nonsingular. Note 
that based on theory of singular perturbations [4] the matrix 
A 4 — P 3 fC 2 V~ 1 C 2 — \P 2 fG^ RG 2 is nonsingular since 
it represents the fast feedback matrix. By the result from 
[74], the stability of the matrix A 4 — P 3 pCjV~ 1 C 2 — 
s P.ipG 2 RG 2 implies that the matrix A 4 — P 3 pC 2 V~ 1 C 2 
is stable also. Using (141) we see that A 4 — K 2 C 2 + O(e) 
is a stable matrix. Thus, the matrix A 4 —K 2 C 2 is stable for 
sufficiently small values of the small singular perturbation 
parameter e. The unique solutions of equations (169) can 
be easily obtained either by using the Newton method or 
the fixed point iterations starting with the following initial 
conditions 

L (0) = (A 4 - K 2 C 2 )~\A 3 - K 2 C 4 ) 

(170) 

= (A 2 - K&KAi - KjC*)- 1 

Hence, the optimal Kalman filter obtained by applying 
the following similarity transformation 


Cs(t) 

— T^ 1 

iiW 

L6(*)J 

— -Lp 

p2 (t)_ 


produces in the new coordinates the optimal pure-slow and 
optimal pure-fast, reduced-order, Kalman filters, that 
is 
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(172) 

where the pure-slow and pure-fast Kalman filter gains are 
given by 


K s 

hKt 


= T 


-l 


K i 


(173) 


Using the expression for the similarity transformation de¬ 
fined in (168) we can obtain analytical expressions for 
a s , a ,-, K s , Kf as follows 


a s = (A ± — Kid) — (A 2 — K 4 C 2 )L 
a ■ — (A 4 — K 2 C 2 ) + cL(A 2 — h iG 2 ) 
K s = Ki - HK 2 - eHLKi 
Iv f — Iy 2 T 6 LIY i 


(174) 


The reduced-order, independent, pure-slow and pure- 
fast, filtering equations (172) represent the main result of 
this section. Due to complete independence of the slow and 
fast filters, the slow and fast signals can be now processed 
with different sampling rates. In contrast, the original, 
full-order, filter (144) requires the fast sampling rate for 
processing of both the slow and fast signals. 

III. COMMENTS 

In Sections 1 and 2 we have presented solutions by the 
Hamiltonian approach to continuous-time optimal control 
and filtering steady state problems of linear singularly per¬ 
turbed systems. The discrete-time linear-quadratic Gauss¬ 
ian control problem of singularly perturbed systems is 
solved via the Hamiltonian approach in [45], [75]. The 
open-loop discrete-time linear-quadratic optimal control 
problem is solved in [76]-[77]. The results for the 
optimal control and filtering for singularly perturbed sys¬ 
tem in discrete-time by the Hamiltonian approach are not 
obtained yet. This might be an interesting and challenging 
research topic. In addition, the finite time feedback solu¬ 
tion to the linear quadratic optimal control by using the 
presented methodology is an interesting subject for future 
research. 

The open-loop high gain (cheap control) problem in 
continuous-time and the problem of complete and exact 
decomposition of the corresponding high gain (cheap con¬ 
trol) algebraic Riccati equation is presented in [6], The 
small measurement noise Kalman filtering problem via the 
Hamiltonian approach is solved in [78]. In a recent pa¬ 
per [30], the eigenvector method is introduced for simul¬ 
taneous pure-fast and pure-slow block diagonalization of 
the Hamiltonian matrix and the solution of Chang’s alge¬ 
braic equations required for such a decomposition. The 
most fundamental results for the so-called multimodeling 
control problem [5] have been recently obtained in [79]. 
The solution to the cheap control problem of sampled data 
systems has been obtained in [80], Several other research 
problem remain open in the context of the Hamiltonian ap¬ 
proach to singularly perturbed linear optimal control and 
filtering problems. 
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